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Abstract 

Kolmogorov n-widths and low-rank approximations are studied for families of ellip¬ 
tic diffusion PDEs parametrized by the diffusion coefficients. The decay of the n-widths 
can be controlled by that of the error achieved by best n-term approximations using 
polynomials in the parametric variable. However, we prove that in certain relevant 
instances where the diffusion coefficients are piecewise constant over a partition of the 
physical domain, the n-widths exhibit significantly faster decay. This, in turn, yields a 
theoretical justification of the fast convergence of reduced basis or POD methods when 
treating such parametric PDEs. Our results are confirmed by numerical experiments, 
which also reveal the influence of the partition geometry on the decay of the n-widths. 


1 Introduction 

Solving a parameter-dependent family of partial differential equations for a large number 
of different parameter values can be computationally demanding, since the solution of the 
problem for each single set of parameters typically already requires substantial resources. 
Put in abstract form, one aims to hud the solution u of 

FKi/) = 0 (1.1) 

for many different values of a vector y = (yi,..., y^) in a certain range U C where V is 
a partial differential operator V parametrized by y. 

We assume that the problem is uniformly well posed in a separable Hilbert space V whose 
elements depend on a physical variable x ranging in a domain D C M™: for each value of 
y E U, the solution u{y) belongs to V. We thus regard u either as the function y i—)■ u{y) 
from U to V, or as the function (x,y) h-)■ u{x,y) := u{y){x) from D x U to M. 
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Many methods for reducing the complexity of such a task are explicitly or implicitly 
based on the existence of efficient approximations Un of u of the general separable form 




( 1 . 2 ) 


k=l 


for some functions {ui,..., Vn} and {0i,..., 0„,}. For instance, in the reduced basis method 
ca. one constructs {vk}k=i,...,n as particular instances = uiy^) of the solution for well- 
chosen values G U, so that the problem can be solved rapidly by applying, for each given 
y, the Galerkin method in the n-dimensional space spanned these basis functions. Similarly, 
the POD method HI constructs {vk}k=i,...,n by applying a principal component analysis on 
a representative set of instances. Both methods amount to an expansion of u of the above 
form (1.2), although the latter is not explicitly constructed since the values {((>k{y))k=i,...,n are 
computed for each given y by the Galerkin method. In contrast, polynomial based methods 


such as in nnum produce an explicit representation ( |1.2[ ) where the functions y h->• (p^iy) 
are multivariate polynomials. More generally, low-rank tensor methods [15] aim at directly 


building an approximation (1.2) with functions Vk and (pk constructed depending on u. 

The efficiency of such approaches depends crucially on the size of n = n{e), which should 
not increase too rapidly with decreasing error tolerance e in the approximation (1.2). A 


crucial question is how one can obtain bounds for n{e) in terms of e that are not crude 
overestimates, but indeed reflect the minimal required number of terms in an expansion of 
the form (1.2). Such bounds can then give an indication to what extent the considered 


problem is amenable to such approximations. 

First upper bounds can be obtained by placing restrictions on the choice oi (pk- A fairly 
well-studied instance are sparse polynomial expansions. In this case, the functions (pk are 
selected from an a priori chosen basis of tensor product polynomials, for instance 


u. 


,Xx,y) := 




Lu{y), 


(1.3) 




where each Ly(j/) = Y\i=i^yAyi) ^ tensor product of univariate Legendre polynomials of 
degrees n* in the variable ?/*, and A„ is a suitable subset of such multi-indices n = (r'j)i=i,,..,d 
with ip{An) = n. In this framework, one can also treat inhnite-dimensional U, for instance 
y G [—1,1]^, provided that the problem is anisotropic in the sense that the yi have decreasing 
influence as i —)■ oo. We refer to mm where approximations of the basic form ( |1.2[ ) 
with provable convergence rates for the error ||n — Un\\L^(uy) as n —)• -|-oo are derived 
in the inhnite-dimensional framework. These approximations are derived by best n-term 
truncations of Legendre or Taylor expansions, see also mu for numerical methods in this 
line of ideas. 

The question that we aim to address in this work is whether one can obtain provably 


more efficient approximations of the form (1.2) when the (pk are not selected from certain 


hxed basis functions, but are allowed to vary essentially arbitrarily. We do not treat the case 
of inhnite-dimensional y here, but rather consider hnite-dimensional parameter domains U 
in an isotropic setting, that is, with all parameters yi carrying equal weight. 
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When no limitations are imposed a priori on 0^, the relevant benchmark for reduced 
models that aim to guarantee uniform accuracy in V for all values y is the Kolmogorov 
n-width of the so-called solution manifold u{U) C V, which is dehned for n G K by 

dn{u{U))v'■= inf sup min ||n — = inf sup min ||m(?/) — tc||y . (1.4) 

dim(W)=n v£u{U) wGW dim{W)=n y&J wdW 


In general, optimal subspaces Wn corresponding to the inhmum in (1.4) are not easily de¬ 
termined, although greedy methods under certain assumptions provide reduced basis spaces 
for which the approximation errors have comparable rates of decay, see mm- 

A more accessible notion of low-rank approximation results from replacing L°°{U, V) by 
L^(U, V), considering instead the quantities 


6n{u,fi)y:= inf 


dim(VF)=n J wGW 


min ||u(9) - w\\l dij(y ), 


(1.5) 


where p is a given probability measure on U. The subspaces for which the infimum is attained 
can in this case be characterized: u G Lf{U,V^y) induces a Hilbert-Schmidt operator from 
Lf{U,ij) to V defined by 

/ u{y)if{y)dii{y), ( 1 . 6 ) 


u 


with singular value decomposition 

OO 

(l>k) L^(U,y.)-, 


(1.7) 


k=l 


where a := {ak)k>i G f'^(N) is nonnegative and nonincreasing, and {vk)k>i) i4>k)k>i are 
orthonormal bases of V and respectively. It is well known that for given n, the 

infimum in (1.5) is attained by choosing Wn '■= {vk : k = 1,..., n}, and has value 

6n{u,ixYy = ^al ( 1 . 8 ) 


k>n 


The operator Mu also yields a precise notion of rank for u G Lf{U,V) via 

rank(M) := dimrange(A4u) = #{A:: ak ^ 0} , 


(1.9) 


which, in general, is infinite. Note that p may in principle be any probability measure. 
However, a natural choice in the case where the yj are random variables is to take for /i the 
measure associated to the distribution of y, since the quantity which is minimized in (1.5) 
may then also be viewed as the quadratic error E(||m(|/) — Py/u{ii)\\\f). When the yi are 
deterministic, a standard choice is to take for p the uniform probability measure over U. 

Note that since p is a probability measure, we always have 


6n{u,y,)v < dn{u{U))v- 


( 1 . 10 ) 
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On the other hand, polynomial approximation results such as in mm yield estimates for 
these quantities since obviously 


dn{u{U))v < ||m — Un\\L°°{U,V) , 


( 1 . 11 ) 


where Un is an n-term Legendre expansion of the form (1.3). 


The results in this paper construct estimates for both (1.4) and (1.5) which are signif¬ 
icantly sharper than those which could be obtained using the above estimate (1.11). The 
particular class of problems that we focus on are parametric diffusion equations 


- div,,(a(a;, y)Vu{x, y)) = f{x ), x E D C M™, y E U := [-1,1]'^, 
with m,d eN, where the coefficient a has the form 


( 1 , 12 ) 


d 

a(x, y) = a(x) - ^ yii’i(x) . (1.13) 

i=l 

Note that if the initial range of yi is a more general hnite interval /*, the range yi E [—1,1] 
can always be ensured up to a renormalization of xjji and a modihcation of a. While in most 
references there is a positive sign after d(a;), we use here a negative sign for later notational 
convenience. 

Throughout the paper, we assume a to satisfy a uniform ellipticity assumption: there 
exist 0 < r < i? such that 


0 < r < a{x, y) < R < oo , x E D, y E U. 


(1,14) 


In view of (1.13), this entails in particular 

d 


^l'/’i(a:)l < a(a:)->■, ^ |i/’i(a:)l < - a(a:), x£D 


(1.15) 


2=1 


2=1 


We consider the equation (1.12) in its weak form on V := Hq{D), 


-'R,yiA)u(y) = f, 


(1.16) 


2=1 


where f E V' and A, Ai: V -E V' are dehned by 


{Au,v) := j aVu-'Vvdx, {AiU,v) := J ^jJiVu ■ Vv dx , u,veV. ( 1 - 17 ) 

D D 

A simple, yet relevant, model problem that we study in detail - and where it turns out 
that general low-rank approximations can indeed perform substantially better than sparse 
polynomial approximations - is the case of piecewise constant coefficients a, for instance 

d = 1 and ifi = OXoi, d < 1, (1-18) 
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Figure 1.1: Example geometry of piecewise constant coefficients {d = 16) and decay of 
singular values (black) and of ordered Legendre coefficients (gray), see also Section 6. 


where {Di,..., Dd} is a given partition of D. Such problems arise, for example, in the 
analysis of heat conductivity properties of components composed of several materials. 


As an example of what one may expect in such a case. Figure 1.1 shows a comparison 


between the numerically observed decay of (i) the singular values cr^ as in (1.7) with /i being 
the uniform measure in U and (ii) the reordered norms llUi/llv of Legendre coefficients in 
(1.3) where the Legendre polynomials have been normalized in L^(f/,/i), in the case of a 
checkerboard partition of the unit square D into 16 smaller squares. Whereas the norms of 
the Legendre coefficients exhibit a subexponential decay, the singular values are observed to 
decay exponentially. This indicates that, for this particular case, separable approximations 
of u using optimally adapted Vk and 0^, for example using reduced basis or POD methods, 
can perform substantially better than those obtained by best n-term truncation of Legendre 
series. This phenomenon was already observed in [16] and [3]. Here we provide a hrst 
theoretical explanation through a rigorous analysis for various situations. We shall see in 
particular that this effect is significantly connected to the geometry of the partition. 

The rest of our paper is organized as follows: in Section 2, we give two very simple ex¬ 
amples for which the solution manifold u{U) happens to be contained in a hnite dimensional 
space, meaning that dn{u{U))v = 0 for n sufficiently large, while polynomial approximations 
require that the number of terms n goes to -|-cxd in order to converge to u. We then consider 
in Section 3 the general elliptic problem (1.12) with coefficients given by (1.13), and we 


consider its approximation by its truncated power series 


u, 


\u\<k 


n := n{d, k) = 


k + d 
d 


(1.19) 


Our main observation is that under a general condition relating the functions d and 'i/'i, this 
approximation has ra nk r{n) signihcantly smaller than its number of terms n. Using the 
estimate 

dr{n){u{U))v < ||m — Un\\L<^{U,V) i (1-20) 
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this allows us to show that the n-widths oi u{U) decay signihcantly faster than the approxi¬ 
mation error \\u — Un\\L°°(uy)- The general condition applies in particular to the case where a 
is constant and xjji is proportional to Xoi, which corresponds to the above mentioned case of 
piecewise constant coefficients. In Section 4, we specialize on the piecewise constant situation 
and show that low-rank approximations can be obtained through the study of an auxiliary 
parametric problem posed on the skeleton of the partition and involving various Steklov- 
Poincare operators. Using this approach, we prove the exponential decay of the n-widths 
(which justihes the numerically observed decay of the singular values) in the simple case of a 
2x2 checkerboard. We also demonstrate numerically that this behaviour strongly depends 
on the geometry, in the sense that it is lost when considering a partition of D into 4 quadri¬ 
laterals which are not squares. Finally, in Section 5 we discuss the numerical schemes which 
we use in order to perform the numerical experiments. These schemes combine non-adaptive 
polynomial approximations and rank reduction by singular value decompositions. The de¬ 
velopment of numerical schemes which combine rank reduction and adaptive polynomial 
approximation, along the lines of |2], is the subject of current investigation. 


2 Simple examples of exact low-rank representations 


We hrst consider two simple examples where explicit low-rank representations can be given, 
leading to particularly favorable bounds for the Kolmogorov widths of solution manifolds, 
when compared to error bounds for the polynomial approximations. 


Example 2.1. A trivial instance of a situation where a sparse polynomial expansion in y 
gives clearly suboptimal approximations is when all 'i/'i are proportional to a, that is, when 
xjji := CjO with values Cj G M such that (1.14) holds. Then we may write u{y) as a scalar 
multiple of vi := m(0) = A~^ f for all y & U, that is 


u{x,y) = vi{x)(j)i{y), 0i(?/):=(l 


d 

E 

2 = 1 




-1 


( 2 . 1 ) 


which shows that rank(M) = 1, or in other words dn{u{U))v = 0 for n > 1. However, u has 
an inhnite power series 

uix,y) = ^U{x)y^, U 

and therefore polynomial approximation error bounds are inhnitely less favorable than the 
n-widths. 



( 2 . 2 ) 


Example 2.2. We now consider a piecewise constant diffusion coefficient in the case of a 
one-dimensional interval D. Without loss of generality we set D =]0,1[, assume {Hi,..., D^} 
to be a partition of D into d subintervals, and set a := 1 and := OXoi a 0 G ]0,1[. 
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In the interior of each Dj, we then have —(1 + 9yi)u" = f. Hence, with any F such that 
F" = /, for each y and i we obtain 

u{y)\Di e span{XDi,a:XA,-^XDj • (2.3) 

This yields an upper bound of Sd degrees of freedom for u{y). Since there are d +1 continuity 
conditions (independent of y) on u at domain and subinterval boundaries, we have 

rank(M) < 2d — 1, (2.4) 

and therefore dn{u{U))v = 0 for n > 2d — 1, independently of the particular choice of /. 

The same argument still applies for general d that is such that 0 < r < a < i? and 
ipi := OdXDi, some 6 G ]0,1[. Since the rjji have this particular form, on the interior of 
each Di we have the equation 

- (1 + %)(dM')'=/, (2.5) 

which can still be solved by integrating twice as before, and consequently one still has 
rank(M) < 2d — 1. 

Remark 2.3. One consequence of the previous example is an estimate of the n-widths of 
the solution manifold in a case where the parameter range is inhnite dimensional. More 
precisely, assume that the diffusion coefficient a ranges in the set 

A = {a E C^{D): HaHc'* ^ B, 0 < r < a < i?}, (2.6) 

for some B > 0, where C^{D) denotes the usual Holder space for some 0 < s < 1. For 
any a E A, there exists a sequence {an)n>i of piecewise constant approximations for each 
uniform partition into n subintervals such that 

\\a - anWi^oc < Bn~\ n > 1, (2.7) 

and such that we also have 0 < r < < R. Note that this rate is optimal since it is well 

known that dn{A)L°° ~ . Denoting by u{a) the corresponding solution to the diffusion 

equation for this value of a, we know, see e.g. [9], that 

||M(a) - u{an)\\y < r“^||/||v' ||a - a„||^oo < Hr"2||/||y/(2.8) 

We have seen that each M(a„) is a linear combination of 2n — 1 basis functions independent 
of ttn- It follows that 

dn{u{A))v < Cn~^, n > 1. (2.9) 

In other words, in this particular case, the map a h-)■ u{a) preserves the decay rate 
between the n-widths of A in L°°{D) and of u{A) in V = Hq{D), respectively. A result of 
this form was proved in [8] for a general holomorphic map a i—>■ u{a), however with a loss of 
1 in the value of s. 
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3 Using power expansions 


We return to the general formulation (1.16). It has been shown in m that under the 
assumption (1.14), u has a Taylor series expansion 

u{y) = ’ 


U = -jd,yu{0) , 
z/! 


(3.1) 


converging unconditionally in L°°{U,V). The Taylor coefficients ty can be computed by 
differentiating the equation 

d 

(-4 + ^ yiA^u{y) = f, (3.2) 

i=l 

at y = 0. For z/ = 0 the null multi-index, we have to = A~^f and for other values of z/, 
application of the Leibniz rule gives 

U = ^ A~^AiU_ei, (3.3) 


where Cj denotes the Kroenecker vector with 1 at position i. Introducing the abbreviations 

Br.= A-^A, g:=A-^f, (3.4) 

we hnd that the partial Taylor sums can be re-expressed in the form 

k d ^ 

Uk{y) := ^ t^y^ = ^{^yiB?j 9- (3.5) 

\u\<k £=0 1=1 

Thus the Taylor expansion can also be interpreted as a Neumann series, 

d ^ oo d ^ 

u{y) = (^ - X] yiB?j U V = yiB^ 9 ■ (3.6) 

i=l £=0 i=l 

We now introduce the inner product (•, •)^ := {A -, ■), and its corresponding norm || ■ ||^, 
on 1/ = which in the case a = 1 coincide with the standard inner product and norm 

of V. More generally, we have the norm equivalence 


’■Ih'llv £ ll>’ll/i £ Zi||f|lv. 


(3.7) 


The following proposition yields an estimate for the rate of convergence of the series (3.6). 


Proposition 3.1. Under the assumption (1.14), we have 

d 


l^ViBiV 


2 = 1 


A 


veV, ye U, 


(3.8) 


< 1 . 


where 


p:=l- 


r 


(3.9) 









Proof. Let u := then by definition 


J aVu ■ Vw dx ='^^yi j fjiVv-Vwdx, w E V. 


D D 

Taking w = u, and using the Cauchy-Schwarz inequality, we obtain 

. d 


MW < ||m|U II^^IU sup 3^ Y] MiM)\ 
a;en> aM) 


Using (1.15) we arrive at the assertion. 

Note that the total number of separable terms in Uk is bounded by 

n = n{d, k) := #{n: |z/| < k} = 


(3.10) 


(3.11) 


□ 


(3.12) 


and we have < n{d,k) < (^ + 1)^- Hence in view of Proposition 3.1, Uk provides an 
approximation with error 



lln uP\ r 

\\U Mfc|Uoo([/y) P , P •— J- II II , 

P Halloo 

(3.13) 

and with rank 


rank(Mfc) < n{d, k) < {k + 1)'^. 

(3.14) 

Setting k{d,n) 

:= max{/c E N: n(d, k) < n} > M — 1, we find on the one hand that 



rank(nfc(rf,„)) < n. 

(3.15) 


and on the other hand that 


L _ u,., d| < < g-|lnp|nVd 

\0 “A:(d,n) ||£,oo(^y) ^ 


In summary, (3.5) thus provides the bound 




(3.16) 


(3.17) 


for the n-widths of the solution manifold u{U), where the multiplicative constant depends 
on g and p. 

As an example of a rather general structural property of the problem that leads to a 
reduction in the n-widths, we consider the additional assumption 


d 

Y,A = 0A. 

i=l 


(3.18) 


9 








In our setting, this holds if 'ipi = aipi with the (pi forming a scaled partition of unity, that is, 
p>i = d ior a 9 g] 0, 1[. The case of piecewise constant a is a particular instance, where 
d is constant and '0* = dOXoi with {Di, ..., Dd} a partition of D. 

Note that (3.18) is equivalent to Bt = 91. Let us consider hrst the consequences in 
the case d = 2, where this implies 


k k 

Uk{y) = + y2B2yg = ^ {9y2l + {yi - y2)BiYg . 

i=o j=o 


We can rewrite each term in the sum as 


(3.19) 


(j/iBi + yA)’g = (yi - y2)Biyg = 

1=0 


j-t ( J 


{y,-y2YB{g. (3.20) 


Exchanging the order of summations in the sums over ^ and j, setting 

k 


Vi := B{g , (pkAv) ■= iVi “ V^Y 

j=e 


i-iP 


we thus obtain 


Uk{y) = ^ykAy)'^i- 


£=0 


Consequently, under the assumption (3.18) the rank of Uk has the linear bound 

rank(Mfc) < k + 1, 


(3.21) 


(3.22) 


(3.23) 


which is obviously more favorable than the quadratic bound given by (3.14) in the generic 
case. The same reasoning can be applied when d > 2, leading to the following result. 


Proposition 3.2. If (3.18) holds, for each k there exist vy and d-variate polynomials 
(fi, with £=!,..., n{d — l,k), such that 


n(d—l,k) 

Uk{y) = PAy)^i^ (3-24) 

1=1 

and therefore 

rank('Ufc) < n{d — l,k) < {k + 1)'^“^. (3.25) 

Proof. Analogously to the above considerations for d = 2, we obtain 

k d . k d—1 ^ k ^ 

= ^^kAyd){^{yi-yd)BY) , ikAyd) ■= 

j=0 i=\ ^=0 i=l j=i ^ '' 
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For notational convenience, we define the operators ^ for mnlti-indices k = {ki, ..., Kd-i) 
snch that 

^ (3.27) 

\k\=£ 


{y,B, +... + Vd-iBd-iY = •= 2/1 ^ ■ yT-Y 


Note that the bY^ are thus precisely the sums of powers of i = 1,..., d — 1, that arise in 
a Taylor expansion of uiy) with respect to j/i,..., Hd-i- Using this to rewrite the right hand 
side in (3.26), we arrive at 

Uk{y) = -ik,\K\{yd)y^■ (3.28) 

\K\<k 


Let he an enumeration of {|k| < k}. We then obtain the assertion by 

choosing 

■= , (j)kAy) ■= 'ik,\Ke\{yd)y'"' ■ □ 


As can be seen from the proof, the functions Vk in Proposition |3.2| are precisely the Taylor 
coefficients of Av)- a consequence of the proposition, under the additional 

assumption (3.18), the generic estimate (|3.17) improves to 




(3.29) 


Note that in view of (1.8) and ( 1.10[ ), this estimate implies that the singular values in (|I3 
satisfy 

(3.30) 

k>n 

and in particular 


In these estimates, the multiplicative constants depend on g and p, similar to (3.17). 


4 Using the geometry of the partition 


As noted above, the assumption ( 3.18[ ) can hold under more general conditions than a piece- 
wise constant coefficient a. The reduction in the bound for the n-widths between (3.17) and 


(3.29), however, weakens rapidly as d increases. In particular, the number of terms required 


to meet a certain error bound still grows exponentially in d. In order to obtain stronger, 
but also more specialized results, we now focus on certain parametric forms of a which are 
described through a partition of D. 
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4.1 Steklov-Poincare operators 

For given a G L°°{D) with ess inf a > 0, we consider -ipj := with a hxed 9 g] 0, 1[, where 

for the moment, {-D*} is a partition of D into general Lipschitz subdomains. We denote the 
skeleton of this partition by 

d 

r:=\JdD,\dD (4.1) 

i=l 

and dehne Vr as the space of trace values of functions in 1/ on F, also denoted by hr : = 
1 

Hqq^T), which we equip with the norm 

lltcllyj, := min{||n||^: v G V, n|r = tc}. (4.2) 

We also introduce for each i = 1,... ,d the space Vi := Hq^Di) viewed as a closed subspace 
of = Hq{D) by regarding its elements as extended by zero to all of D. The direct sum 
Fi © • • • © Vd is a closed subspace of V, and we denote by W its 4-orthogonal complement 
in V. 

Furthermore, we introduce for each i = 1,... ,d the 4-harmonic extension operator Ei 
from Vr to the space 

H\D,) n H^,{D) := {v G H\D,) : vU = 0}, (4.3) 

which maps the trace value wr ^ W to the extension EiVr dehned by 

j dVEiVr -Vwdx = 0 for all w G V, Eiv\ 9 D,ndD = 0, Eiv\eDinr = vr\dDi ■ (4.4) 

Di 

In the case where d is constant, this is the usual harmonic extension. We dehne the operator 
E from Vr to V that concatenates these extensions into a function dehned on E by 

E:vri-^Evr, EvrlDV-=i = ■ ■ ■, d. (4.5) 

Note that the space W coincides with the range of E. 

The operators Bi = A~^Ai are self-adjoint in the 4-inner product, and for each i they 
have the properties 

Bi\v^ = /, Bi\v^ = 0 for j A i- (4.6) 

Consequently, these operators also map W to itself. 

We now decompose uiy) into the sum of its 4-orthogonal projections onto the Vi and IF, 
according to 

d 

u{y) = uw{y) + Ui{y). (4.7) 

i=l 

The component Ui{y) G F solves 

(1 - %) j dVUi{y) ■ VV dx = j f v dx , v e V, and Ui{y)\D\Di = 0 ■ (4-8) 

Di Di 
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Each Ui is therefore of rank at most 1, depending only on yi, and therefore has rank 

at most d. 

The component uw can also be written in the form uw{y) = Eur{y) for a ur{y) G Vr, 
where ur{y) is characterized by the variational problem 


— 6yi) j aVEur{y) ■ VEvr dx = j fEvrdx, vy&Vy- 

D, D 


(4.9) 


To obtain a more concise formnlation of the equation for up, we introduce the Steklov- 
Poincare operators S'*: —>■ fp, i = 1,..., d, and Vp —)■ fp dehned by 


(S'iUpjtcp) ;= j aVEvr ■ V Ewr dx, vr,wr G Vr, 

Di 

and 

d 

i=l 

The norm of Vr is induced by the inner product 


(4.10) 


(4.11) 


{u,v)r ■= {Su,v) = / aVEu-VEvdx. 


(4.12) 


D 


In particular, the operator S is bounded, elliptic, and dehnes an isometry between Vr and 


I/'. 


Using the operators Si and S, we can now rewrite (4.9) as 

d 


S - eY,V,S,My) = fr, 


(4.13) 


2=1 


where /p G Up is dehned by 


(/p,np) := / fEvrdx, Up G Up . 


(4.14) 


D 


We thus obtain the Neumann series representation 


k d 


Ur — lim Uk,r, Mfc,: 

fc^OO 


■rW -E Sr- 


e=o i=i 


(4.15) 


where gr ■= S ^/p. By a similar argument as in the proof of Proposition |3.1[ we obtain that 

d 

veVr,yeU, (4.16) 




2 = 1 


Vr 
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which shows that the Neumann series converges in L°°{U, Vr). 

Note that the Neumann series for u can be rewritten as 

d 

Uk{y) = Euk,riy) + Uk,iiy), (4.17) 

i=l 

where Uk^iiy) is the A-orthogonal projection of Ukiy) onto V). Similar to Uj, the rank of 
is at most 1. Therefore 

rank(Mfc) < d + rank(Mfc^r) • (4-18) 

The task of obtaining favorable bounds for the rank of Uk is thus in the present setting 
essentially reduced to obtaining similar such bounds for the rank of Uk,T, which is defined on 
T X 17. We shall see next that what one obtains in this regard can depend strongly on the 
particular geometry of D and T. 


4.2 A particular example: four squares 

We now turn to the case of piecewise constant coefficients, with each piece varying within 
the same range of values, where we may assume without loss of generality that a = 1 . 
We consider the case of the unit square D =] — partitioned into the four symmetric 

quadrants. 


Di=]-i,0P, D,=]0,l[x]-l0[, Zl3=]-|,0[x]0,i[, 714=]0,4P 


(4.19) 


and with V'i := dXoi, ^ ![• 

In order to motivate what follows, we first consider a numerical experiment, where we 
compare the decay of the 17-norms of the tensor product Legendre coefficients Ui, as in (1.3) 


to the decay of singular values ak in the decomposition (1.7). We execute these computations 


under a fixed space discretization through a finite element space Vh. the exact solution map 
y H->• u{y) is replaced by y h->• Uh{y), where Uh{y) is the Galerkin projection of u{y) onto the 


space Vh- We compare the results obtained for (a) the symmetric partition (4.19) to those for 


(b) a non-symmetric partition into four quadrilaterals which may be viewed as a distorted 


version of (4.19). As explained further in Section 5, in order to obtain result that reflect 


the behavior of the Legendre coefficients and singular values for the original solution map 
y H->■ u{y), it is extremely important to resolve the subdomain interfaces appropriately in the 
spatial discretization. Figure [T^ displays the typical meshes that we use for the symmetric 
partition (4.19) and the distorted partition. We employ piecewise linear finite elements on 


further refined meshes, which gives 59 365 degrees of freedom, 4 105 of these on subdomain 
interfaces. For the discretization in the parametric variable, we use Galerkin projection onto 
tensor product Legendre polynomials of total degree at most 15. We therefore compute 
( 4 ^) = 3876 Legendre coefficients Uh^v, each of which is a hnite element function from Vh- 
A detailed discussion of the precise computational procedure is deferred to Section The 
given results are obtained with the choices / := 1 and 6 
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(a) (b) 

Figure 4.2: Example meshes for the two test geometries with 992 triangles and 521 vertices. 
The meshes used in the actual computation have 119 272 triangles and 59 909 vertices with 
a similar gradation towards subdomain boundaries. 


In Figure 4.3, we compare the decay of the E-norms of the Legendre coefficients Uh,u to 
the decay of singular values ak in the decomposition (1.7) where we have replaced E by 14 
and uiy) by Yli\v\<ib'^h,uLy{ii) in the dehnition of In both cases (a) and (b), the second 
sequence decays substantially faster. However, although the Legendre coefficients behave 
almost identically in the two cases, we observe an exponential decrease of the ak in case (a), 
but only a sub exponential decrease in case (b). A closer inspection shows that the decay in 


case (b) is in fact not substantially better than guaranteed by (3.31). 

As explained in Section 5, the Galerkin discretization in the Legendre basis up to some 
total order I allows us to exactly compute the truncated power series Uh/{y) = Yli\u\<(.^h,vy'' 


associated to the map y i—)■ Uh{y). Figure 4.4 displays the ranks of the partial sums Uh,k 
for k = 1,..., 10 together with the corresponding singular values. In case (a), these ranks 
are observed to increase approximately linearly in k before the smallest non-zero singular 
values drop below machine precision, whereas the ranks grow more rapidly (faster than 
quadratically) in case (b). Further experiments reveal that there is no qualitative change in 
the results if one prescribes a less regular right hand side /, which shows that the decay of 
singular values is not tied to the spatial smoothness of u. 

Our aim is now to explain the substantially better low-rank approximability observed in 
the case of a symmetric geometry. The remainder of this section is devoted to the proof of 
the following theorem, which requires several preparatory steps. Note that under our present 
assumptions, H-Hq equals the standard norm on Hq{D). 


Theorem 4.1. Let d = A, and let Di, i = 1,... ,4, he defined as in (4.19). For each k gN 


and for n{k) := 8/c -|- 5, there exist Ui,..., Vn{k) G E and d-variate polynomials 0i,..., (j)n{k), 
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Sorted ^-norms of Legendre coefficients 
Figure 4.3: Decay of sorted if^-norms of Legendre coefficients and of singular values, both 


for geometries (a) and (b) in Figure 4.2 (marked by x and o, respectively) 



(a) (b) 

Figure 4.4: Ranks and first 80 singular values of the partial sums of the Neumann series 


for orders fc = 1, 
respectively). 


, 10, and for geometries (a) and (b) in Figure 4.2 (marked by x and o. 
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each of total degree k, such that the truncated power series Ukiy) = Yli\v\<k^i'y'^ exact 

expression 

n{k) 

Uk{y) = (4.20) 

£=1 

Therefore rank(Mfc) < Sk + 5. 


Combining this result with the approximation estimate (3.13) between u and Uk imme¬ 
diately yields the following corollary. 


Corollary 4.2. With the same notations as in Theorem f.l. we have 


sup 

y&U 


n{k) 

n(v) - E (l>e{y) Ve 

e=i 


< 


V 


e 


(4.21) 


and consequently dn{u{U))y < exp(-^n). 
We begin by introducing the notation 


r,:=[-l i|x{0}, r2:={0}x|-l 1 |, 


(4.22) 


for the horizontal and vertical components of the skeleton F of the decomposition (4.19). 


The space Vr introduced at the beginning of this section can be decomposed into the three 
closed subspaces 

Vi := {u G Vp: and u|r 2 are even} , 

V 2 '■= {u G Vp: odd, ujpj = 0} , (4.23) 

C 3 := {u G Vp: 'i^|r 2 odd, u|p^ = 0} . 

The following result decribes the action of E on these spaces. Its proof is immediate from 
symmetry arguments and is therefore omitted. 

Proposition 4.3. For the harmonic extension Ew of w E Vp, we have the following sym¬ 
metry and antisymmetry properties depending on the particular subspaces: if w G Vi, then 
Ew{—Xi,X 2 ) = Ew{xi,X 2 ) and Ew{xi,—X 2 ) = Ew{xi,X 2 ) for a.e. x E D; if w E V 2 , 
then Ew{—Xi,X 2 ) = —Ew{xi,X 2 ) and Ew{xi, —X 2 ) = Ew{xi,X 2 ); and if w E V 3 , then 
Ew{xi, —X 2 ) = —Ew{xi,X 2 ) and Ew{—Xi,X 2 ) = Ew{xi,X 2 ). 

For the proofs of the following results, it will be convenient to introduce the notation 


{u,v)r,i-= J VEu-VEvdx, 

Di 


(4.24) 


so that (m,u)p = Z]Li(“W)r,i- 
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Proposition 4.4. The spaces Vi, i = 1,2,3, form an orthogonal decomposition of Vp with 
respect to the inner product (•, Or- 


Proof. Note first that a unique decomposition into even and odd parts of this form always 
exists. To show orthogonality, for symmetry reasons, it suffices to c onsid er the pairings Vi, 
V2 and V2, V^. If either u & v & V2 oi u & Vi, v & V2, Proposition 4.3 gives 


{u, u)r,2 = -{u, u)r,i, (u, u)r,3 = -(«, w)r,4 , 

and consequently {u,v)y = 0. 

We now consider the following operators: 


(4.25) 

□ 


Ho := S, 

H, := S 1 -S 2 -S 3 + S,, 


H 2 := S, + S2-So- S,, 
Ho:= 8^-82 +So-S,. 


For convenience, we set Gi := 9S~^Hi, i = 0, ...,3. For each k, the partial sums Uk,r 
introduced in (4.15) can be expressed in terms of the operators Gi. We introduce the new 
variables 


zo = zo{y) := -{yi + 1/2 + 2/3 + 2 / 4 ), 
1 

= zi{y) := -( 2/1 - 2/2 - 2/3 + 2 / 4 ), 


2^2 = Z 2 {y) := -( 2/1 + 2/2 - 2/3 - 2 / 4 ) , 
1 

^3 = Zoiy) := -( 2/1 - 2/2 + 2/3 - 2 / 4 ) , 


so that 


J2z^Gi = Y,y^{GS-^Si). 


(4.26) 


i=0 


i=l 


In view of (4.15), we thus obtain the representation 

k 3 

Uk,r{z) = y^Ay^.ziG, 


9r 


(4.27) 


e=o i=o 


As we shall now show, the operators Gi act on the spaces (4.23) in a very particular way, 
which will eventually allow us to obtain the desired rank estimate. 

Lemma 4.5. One has Gi{Vi) = {0} for z = 1,2, 3. 

Proof. Since 8 is an isomorphism from W to fp, we prove the equivalent statement that 
HiiVi) = {0} for z = 1, 2, 3. Let u\ G V and v G Vp. Then by definition. 


(iLizzi, v) = (zzi, u)r,i - (mi, v)r ,2 - (mi, t^)r,3 + (mi, ^^)^,4• (4.28) 

If u G Vi, the four integrals on the right hand side all give the same value, and hence 
{HiUi,v) = 0; if z; G 172 or u G Pg, then using a change of variables and the above antisym¬ 
metry properties, we obtain 


(mi, ^^)^,4 = -(mi, ^^)^,l, (mi, t’)r,3 = -(^i, ^^)r,2 • 


(4.29) 
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We have thus shown {HiUi^v) = 0 for any v G W, or equivalently that HiiVi) = {0}. Next, 
let U 2 G V 2 . Then 


{H 2 U 2 , v) = {u 2 , n)r,i + {u 2 ,v)r ,2 - (^ 2 , v)r,3 - (^ 2 , 'y)r ,4 ■ (4.30) 

If n G W or n G we have 

{u2,v)r,2 = -{u2,v)r,i, (M2W)r,4 =-(“2W)r,3 • (4.31) 

If n G V 2 , again all four integrals give the same value. Thus for all v G Vr, {H 2 U 2 ,v) = 0, or 
equivalently i? 2 (^ 2 ) = {0}. The statement H^iV^) = {0} follows by exchanging the role of 
the coordinates (xi, 0 : 2 ). □ 


Lemma 4.6. One has 


G 2 {V,),G^{V 2 )cV 3 , Gs{V,),GM)cV 2 , and ^3(^2), ^2(1/3) CW. ( 4 . 32 ) 


Proof. By the symmetries in the problem, it suffices to consider G 2 (Vi), Gi(14), and (^ 3 ( 14 ). 
We begin with the following observation: if Uj,Vj G Vj, then 


{HiUj, Vj) = 0 , for all i,j G { 1 , 2 , 3 }. 


To see this, we argue as in the proof of Lemma 4.5, noting that 

{uj, Vj)r,n = {uj, Vj)r,m , n, m G { 1 , ..., 4} , 


(4.33) 


(4.34) 


since Euj and Evj have the same symmetry or antisymmetry properties. We now treat the 
three above cases. 


(i) G2{yi) C V^\ let Vi G Vi- In view of Proposition 4 . 4 , we need to show that H 2 V 1 


annihilates the elements in Vi and V 2 . With wi G W and W 2 G V 2 , we have {H 2 Vi,W 2 ) = 
{v,H2W2) = 0 from Lemma 4 . 5 , and {H 2 Vi,wi) = 0 follows from ( 4 . 33 ). Altogether, this 
gives G2(Bi) C V3. 

(ii) 6 * 1 ( 142 ) c V 3 : let V 2 G 14. With Wi G Vi and W 2 G 1^2, we again have {HiV 2 ,Wi) = 
{v 2 , HiWi) = 0 , and {HiV 2 ,W 2 ) = 0 by ( 4 . 33 ), showing Gi(V 2 ) C V 3 . 


(iii) (63(1/2) C Vi- let V 2 G V 2 . With W 2 ^ V 2 and G 1 ^, we have {H^V 2 ,W 2 ) = 0 by ( 4 . 33 ) 
and {H3V2,W3) = (02,113103) = 0 , which shows (63(1^) C Vi. □ 


Lemma 4.7. For any V 2 G 14, '^3 G V 3 , one has 


G 2 G 3 V 2 — G 1 V 2 , G 3 G 2 V 3 — G 1 V 3 , G\v 2 — V 2 , G\v 3 — V 3 . (4.35) 

Proof. By symmetry arguments, it suffices to show the hrst and the third statement. Let 
P3 := G 2 G 3 V 2 G V 3 , Pi := G 3 V 2 G Vi, and ^3 := G 1 V 2 G V 3 . The hrst statement now reads 
P 3 = qs. By dehnition, 

(Sp3,u) = (H 2 Pi,u), ueVr, (4.36) 
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{Spi,v) = {H 3 V 2 ,v) , 

V E Vp , 

(4.37) 

as well as 



CO 

w E Vp . 

(4.38) 

For given w G we now set 



^ • {^^{x^D : X2<0} ^{x^D: 

X2>0})u E V . 

(4.39) 


For this choice of v, the definition of {ifi, 1 / 2 ,-ffs} shows that we have {H 2 Pi,u) = {Spi,v) 
as well as {H^V 2 ^v) = {HiV 2 ,u). Using (4.36) and (4.37) this implies {Sp 3 ,u) = {HiV 2 ,u) 
for any u G U 3 . By (4.38), we thus reach 

{Sp3,u) = {Sq3,u), M e U3. (4.40) 


By Lemma 4.5, both sides in the above equality vanish in the the case where m G Vi © V 2 . 
Since S is an isomorphism, it follows that ^3 = ^ 3 . 

Let p 2 := G‘^V 2 and qi := G 3 V 2 - The third statement reads p 2 = V 2 - By definition of p 2 
and gi, 

{Sp 2 ,u) = {H 3 qi,u), ueVt, (4.41) 

{Sqi,v) = {H 3 V 2 , v) , V eVr. (4.42) 

For u E V 2 , we set 

V := {X{x&D: a:i<0} “ X{x&D: a:i>0})w G Vi- (4.43) 

For this choice of v, the definition of H 3 shows that we have {H^qi^u) = {Sqi,v) and 
{H 3 V 2 ,v) = {Sv 2 ,u). Using (4.41) and (4.42), we reach 


{Sp 2 ,u) = {Sv 2 ,u), UEV 2 . 


(4.44) 


By Lemma 


4.5 


both sides in the above equality vanish in the the case where u G Vi © V3. 
Since S is an isomorphism, it follows that P 2 = V 2 - □ 


Recall that our aim is to bound the rank of the representation (4.27) for each order k, 
which is bounded by the number of linearly independent elements of Vp that are created 
applying compositions of the operators G*, i = 1,2,3, up to order k, to gp. In other words, 
defining 

Fkiv) := {n} U {Gi^ ■ --Gi^v: I < j < k, U, ... G {1,2,3}} (4.45) 


for any given v E Vp, we have rank(Mfc^r) < n{k) := dim span F'fc(gr)- Note that this strategy 
for obtaining rank bounds can be regarded as the opposite of the one used in Section 
which was based on instead grouping terms in the partial sums Uk according to common 
polynomial degrees. 

One has the trivial bound 


n{k) < i^Fkigp) <3^ + 1. 


(4.46) 
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92 


93 


9i 


G 291 


GsQi 


G1G291 * G\gi GiG^gi ■< G'lgi 


_ n2. 


GlG 2 gi - G3G1G251 GlG^g^ ^ G2G1G351 




Figure 4.5: Illustration of the proof of Lemma 4^, where Qv = Qi + 92 + 5 ' 3 - 
Using the decomposition 

Qr = 91+ 92 + 53 , 

with 9 i E Vi, we obviously have 

spanFk{9r) C span{Ffc( 5 (i) U Fk{92) U ^*.( 5 ( 3 )}, 

and therefore 

n{k) < ni{k) + n 2 {k) + n 3 {k), ni{k) := dim span Ffc( 5 (j). 


(4.47) 

(4.48) 

(4.49) 


Lemmas 4.5 and 4.6| allow us to bound the number of non-zero elements in Fk{ 9 i), and 
therefore ni{k), by 2^+^ — 1. We thus obtain the slightly better estimate 


n{k) < 3 ( 2 ^+^ - 1) 


(4.50) 


Note that these estimates are both much weaker than the bound of order k^ that we have 
for rank(Mfc) as a consequence of the results in Section]^ However, with the help of Lemma 
4.7, we now show that the number of non-zero elements in each Fk{ 9 i) in fact grows only 
linearly in k, which explains our initial numerical observations and leads us to the proof of 
Theorem 14.11 


Lemma 4 . 8 . Let 92 G V2. Then for each k eN, the only non-zero elements in Fk{92) are 
\^G\92'. 0 < i < fc} U {G2G\92'- i odd, 1 < i < /c} U {G'iG\92'- i even, 0 < i < fc} . ( 4 . 51 ) 
Let 93 E V3. Then for each k eN, the only non-zero elements in Fk^ys) are 
[G\93: 0 < i < A:} U {GsGlys: i odd, 1 < i < fc} U {6*2^353: i even, 0 < i < A;}. ( 4 . 52 ) 


The idea behind the proof of Lemma |4.8[ which combines Lemmas mm and m i 


IS 


illustrated on the two graphs on the right of Figure 4.5 The nodes in these graphs represent 
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the only possible non-zero fnnctions that can be created by repeated application of the 
operators Gj, z = 1, 2, 3, to a given g 2 G V 2 or G V 3 . The hrst graph on the left represents 
the only possible non-zero fnnctions that can be created by repeated application of the Gi 
to a given gi G Vi. This hrst graph is actually obtained by applying the third and second 
graphs on its hrst two nodes G2gi G V3 and G^gi G V2. 


Proof. It suffices to prove the result for Fk{g2), since the result for Fk{g3) follows by sym¬ 
metry. For each A;, we use the abbreviation Fj. := Tfc( 5 ' 2 ) and denote the set in (4.51) by 

Rk = Rk,l U Rk,2 U Rk,3 ■ (4.53) 

We show that Fk = Rk^ {0} for all k > 1. In the case k = 1, we have 

Fk{92) = {g2,Gig2,G2g2,G3g2} = {g2,Gig2,0,G3g2}, (4.54) 

which proves the claim in this case. We assume the claim holds for a fc > 1, and we thus 
need to show that Fk+i = Rk+i U {0}. The inclusion Rk+i U {0} C Fk+i follows trivially 
from the dehnitions. To show that Fk+i C Rk+i U {0}, note hrst that from the dehnition of 
Fk, we have 

3 

Fk+i = {g 2 }u[jGi{Fk) 

i=l 

and hence, by our induction hypothesis, 

3 

Rk+i = { 92 } U Gi{Rk U {0}). 


(4.55) 


(4.56) 


i=l 


By Lemma 4.6, G\g2 G V2 for i even and G\g2 G V3 for i odd. Thus 

Gi{Rk,i) C Rk,i U {Gi~^^g2} = Rk+1,1, 

G2iRk,i) = {0} U {G2G\g2. i odd, 1 <i < k} = {0} U Rk+1,2 , 
G3{Rk,i) = {0} U {G3G\g2 ■ i even, 0 < z < A:} = {0} U Rk+1^3 ■ 


By Lemma 4.6, Gi{Rk,2) = Gi{Rk,3) = {0} and by Lemma 4.7, Gi{Rk,j) C {0} U Rk+1,1 for 
i,j G {2, 3}. Since furthermore {g2} C Rk+1,1 for each k, we arrive at Fk+i = i?fc+iU{0}. □ 


With Lemma |4.8| at hand, we can now prove Theorem |4.1 
Proof of Theorem fG. Invoking ( |4.18[ ), we know that 

rank(zzfc) < 4 -|- Ya.iik{uk,r), 


(4.57) 


and by the representation (4.27) the rank of Uk,r is bounded by the number of linearly 
independent vectors in Fk^gv). 

After an orthogonal decomposition of gr in the form gv = gi + g 2 + 93 with gi E Vi, 
Lemma [478] can be applied separately to Gsgi, G 2 gi, g 2 , 93 - This shows that the number of 
non-zero elements in Fk{gi) is at most {2k + 1) for z = 2 and z = 3, and at most 1 -|- 2(2A: — 1) 
for z = 1. In conclusion, Fk{gr) contains at most 1 -|- 2{2k — 1) -|- 2{2k -|- 1) = 8A: -|- 1 linearly 
independent elements, which conhrms the estimate 8A; -|- 5 for rank(zzfc). □ 
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5 Numerical construction of low-rank approximations 

The numerical scheme used for the computational examples in this work is based on the 
iteration 


Uo:= A = g, Uk := A ^(f + ^ yiA. 


iUk-i = g 


+ yjBjUk-i , fc € N ■ (5.1) 


2=1 


2=1 


As a consequence of Proposition 3.1, this is a hxed point iteration with linear convergence 


in L°°{U, V). The iterates Uk are precisely the partial sums (3.5), that is, 


My) = M'' = 


\v\<k 


i=0 2=1 


(5.2) 


Since we shall use the singular value decomposition to obtain low-rank approximations, we 
regard u and the Uk as elements of L‘^{U,V) ~ 1/ (8) L‘^{U) with the uniform probability 
measure y on U, and consider convergence in this norm. 

We hrst introduce a discretization in the parametric variable ?/, based on a choice of basis 
for L‘^{U). We use here the orthonormal tensor product Legendre polynomials L 
The set of basis indices used in the computation is of the form 


z/ e Nq. 


|i^| < J} , 


(5.3) 


SO that span{L,^}i,gAj = Pj, the space of polynomials of total degree at most J. For each 
i, the operator corresponding to multiplication by yi on L‘^{U) is replaced by its Galerkin 
discretization M* ;= ((yjLj,, which is a bidiagonal matrix (we refer to P! 

for further details). Note that in this semidiscrete setting, as long as k < J, all operations 


in (5.1) are represented exactly, and consequently we exactly recover Uk for k < J. As k 


increases further, Uk converges to the Galerkin projection Gju of u onto the space V ® Pj. 
This projection is dehned by 


a(x, y)Va:Gju(x, y)Vxv(x, y) dx dy{y) = f{x)v{x, y) dx dy{y), n e G 0 Pj. 




u D 


u D 


(5.4) 

The discretization is completed by replacing G by a fixed hnite element subspace 14 of 
dimension Mh- The corresponding discretizations of A, Ai, and / are denoted by A, Aj 


and f, respectively. The iterates in the discretised version of (5.1) can then be regarded as 


matrices G := = n{d, J). As /c —)■ -|-oo, these iterates converge to 

the representation coefficients of the Galerkin projection of u on the space 14 G Pj. 

In order to exploit the low-rank approximability, we modify the discretized version of 
(5.1) by introducing additional truncations based on the sizes of the singular values. This 


requires that we work using low-rank representations of the iterates. If is given in low- 
rank form Ufc = with G ^ j^Njxr^ < iam{Mh, Nj}, one step 
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of the discretized iteration can be done by computing 


Uj+i := (A-'f)eJ + 5 ^(A-‘A.Vj)(MA)' 


(5.5) 


2=1 


Here eg := {^ov)v&Kj-, regarded as a column vector. Thus (5.5) yields a representation of the 
~ ~ ~ T 

form Ufc+i = with formal representation rank r^+i = nrk + 1 , which may be larger 

than rank(ufc+i). To detect and computationally exploit further low-rank structure in Ufc+i, 
we truncate its singular value decomposition (SVD) up to a prescribed tolerance Sk in the 
Frobenius norm. Note that in doing so, we need to use the norm induced by A on I 4 . To 
achieve this, we compute a sparse Cholesky decomposition A = LL^, perform the truncated 
SVD on L^Ufc+i, and pre-multiply the result by L~^. The actual SVD can performed at a 
total cost of order ma.x{Mh, Nj} rl_^_-^ by orthogonalizing the columns of L^V^+i and 
and then performing an SVD of a matrix of size fk+i x fk+i- We dehne u^+i = 
with rank r^+i < r^+i, as the result of this rank truncation. 

Note that these new iterates differ from the initial iterates dehned by only performing 
the discretised version of (5.1). With appropriately chosen truncation parameters Sk, as 


fc —)■ 00 the iterates converge linearly to the representation coefficients of the Galerkin 
projection of u on Vh ^ Pj, similar to the initial iterates. The precise choice of the Sk is 
crucial not only for ensuring convergence, but also for the efficiency of the resulting scheme. 
A choice that can be shown to achieve this balance is given in [2]. In our present setting, 
our aim is less to obtain an efficient method than to closely reproduce the exact Uk, and we 
thus use Sk = 10 “^^, i.e., a truncation tolerance close to machine precision, for all tests in 
this work. 

Concerning the choice of I 4 , no triangles in the mesh should be intersected by subdomain 
boundaries, since this has a negative effect on the approximation error. Note further that 


if this is taken into account, as a consequence of (4.18), the maximum rank of the that 


can be observed numerically is bounded by d plus the number of degrees of freedom on the 
skeleton T. This means in particular that in order to obtain results that reflect the actual 
decay of the singular values of u, when using only uniformly refined triangulations one needs 
very fine meshes to produce sufficiently many degrees of freedom on T. For this reason, in 
our numerical experiments we use meshes with a strong gradation towards F. 


6 Conclusions and outlook 


We have constructed low-rank approximations of solutions of certain parametric elliptic prob¬ 
lems, based on assumptions on additional structures in these problems. Our analysis reveals 
particular mechanisms which, for specific problems, may ensure significant improvements 
between low-rank approximations based on truncated polynomial expansions and optimal 
low-rank approximations. 

Whereas the rather general assumption (3.18) yields only a rather modest improvement 
in the n-widths as compared to estimates obtained by a direct polynomial expansion, we 
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Figure 6.6: Decay of singular values and ranks of partial sums for 16 parameters. 


arrive at a much stronger estimate in the particular setting considered in Section 4.2 As 


demonstrated there, this improvement depends rather strongly on the symmetries in the 
geometry of the problem. Numerical experiments indicate that the exponential decay of the 
singular values is maintained in the case of a similar d = m x m checkerboard structure on 
the unit square, however with no general proof available at the present stage. 

As an illustration we reconsider in more detail the problem with 16 parameters of Figure 
EH with a partition of D analogous to ( |4.19[ ), but with a 4 x 4 checkerboard pattern of 
squares of side length The numerical realization was done as in the numerical experiments 
in Section 4, here using total degree 5, resulting in 20 349 Legendre coefficients. The spatial 
discretization uses piecewise linear finite elements with 112 961 degrees of freedom, with 
12 345 of these on subdomain interfaces. 

A more detailed view of the ranks of partial sums Uk and of the decay of the corresponding 
singular values is shown in Figure 6T The observed decay of singular values is slower than 
in the example of Section 4, but clearly still exponential. However, here the ranks of partial 
sums increase faster than linearly. This indicates that analyzing the ranks of partial sums 
alone, as in the 2x2 checkerboard case, might not be sufficient to explain the exponential 
decay in this case, and that a finer analysis of the singular values associated with these 
partial sums may be required. 
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